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We demonstrate that there does exist an equilibrium description of thermodynamics on 
the apparent horizon in the expanding cosmological background for a wide class of mod- 
ified gravity theories with the Lagrangian density f{R, (j>, X), where R is the Ricci scalar 
and X is the kinetic energy of a scalar field (p. This comes from a suitable definition of 
an energy momentum tensor of the "dark" component obeying the local energy conser- 
vation law in the Jordan frame. It is shown that the equilibrium description in terms of 
the horizon entropy S is convenient because it takes into account the contribution of the 
horizon entropy S in non-equilibrium thermodynamics as well as an entropy production 
term. 

Keywords: Modified theories of gravity; Quantum aspects of black holes, evaporation, 
thermodynamics; Dark energy; Cosmology. 



1. Introduction 

The discovery of black hole entropy has implied a profound physical connection 
between gravity and thermodynamics.fllThe gravitational entropy S in the Einstein 
gravity is proportional to the horizon area A of black holes, such that S — A/ (4G), 
where G is gravitational constant. A black hole with mass M obeys the first law 
of thermodynamics, TdS — dM, where T = Kg/ {2tt) is a Hawking temperature 
determined by the surface gravity k^.- Since black hole solutions follow from the 
Einstein field equations, the first law of black hole thermodynamics implies some 
connection between thermodynamics and the Einstein equations. In fact, it was 
showrf^ that the Einstein equations can be derived by using the Clausius relation 
TdS* = dQ on all local acceleration horizons in the Rindler space-time together with 
the relation S oc A, where dQ and T are the energy flux across the horizon and 
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the Unruh temperature seen by an accelerating observer just inside the horizon, 
respectively. 

In the theories in which the Lagrangian density / is a non-linear function in 
terms of the Ricci scalar R (so called "/(i?) gravity"), it was pointed oui[^ that a 
non-equilibrium treatment is required so that the Clausius relation may be modified 
to dS = dQ/T + d^S, where the horizon entropy S is defined by 5* = F{R)A/ {4G) 
with F{R) = df /dR and d^S* describes a bulk viscosity entropy production term. 
The variation of the quantity F{R) gives rise to the non-equilibrium term diS 
that is absent in the Einstein gravity. The reason why a non-equilibrium entropy 
production term diS appears is closely related to the theories in which the derivative 
of the Lagrangian density / with respect to R is not constant. It is meaningful to 
examine whether an equilibrium description of thermodynamics is possible in such 
modified gravity theories. In the present paper, we review our resultJ^ in Ref. |6] 
and show that equilibrium thermodynamics does exist for the general Lagrangian 
density f{R,(j),X) including f{R) gravity and scalar-tensor theories, where / is 
function of i?, a scalar field 0, and a field kinetic energy X = -(V0)V2. We 
mention that in Ref . [71 the derivation in Ref. ^ was also extended to f{R) gravity. 



2. Thermodynamics in modified gravity-non-equilibrium picture 

We consider the following action 

/ - J d^x^f{R,4>,X) - J d^xCMi9^..,^M) , (1) 

where g is the determinant of the metric tensor g^^, Cm is the matter Lagrangian 
that depends on and matter fields '^'m, and X — ~ (1/2) g^'^V^t^Viy^ is the 
kinetic term of a scalar field (V^ is the covariant derivative operator associated 
with g^jy). The action ([T]) can describe a number of modified gravity theories, e.g., 
f{R) gravity, Brans-Dicke theories, scalar-tensor theories, and dilaton gravity. It also 
covers scalar field theories such as quintessence and k-essence. From the action ([T]) , 
the gravitational field equation and the equation of motion for (f) are derived as 

FG^, = SvrGT^f ) + ^g^M ~ RF) + V^V.F - g^^DF + ^f.xV^^V,^ , (2) 
^ --d^ {f,xV^g^-d,c^) +f,4,^0, (3) 



where F = df/dR, /,x = df/OX, = Of/dcj), T^f ^ = (2/v^)^£M/<5g''^ and 
Gf_i,u = Rfj,u — (1/2) gfj.uR is the Einstein tensor. Throughout this paper, we use 
for the partial derivative with respect to the variable Y. For the matter energy 
momentum tensor Tl^f/\ we consider perfect fiuids of ordinary matter (radiation 
and non-relativistic matter) with total energy density pj and pressure Pf. 

We assume the 4-dimensional Friedmann-Lemaitre-Robertson- Walker (FLRW) 
space-time with the metric, ds^ = hapdx^dx^ + f^dfi^, where f = a{t)r and = 
t,x^ — r with the 2-dimensional metric /i^^ = diag(— 1, a^(t)/[l — Kr'^]). Here, a(t) 
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is the scale factor, K is the cosmic curvature, and dfl^ is the metric of 2-dimensional 
sphere with unit radius. In the FLRW background, from Eqs. © and ^ we obtain 
the following field equations: 

3F + K/a^) = lxX + ^{FR- f)- 3HF + SirGp / , (4) 



2F i^H - K/a^j = f^xX + F-HF + 87rG(p/ + Pf) , (5) 
a'0/,x)' =/,0, (6) 



a3 ( 



where H — a/a \s the Hubble parameter and the dot denotes the time derivative 
of d/dt, and the scalar curvature is given by i? = 6{2H^ + H + K/a^). The perfect 
fluid satisfies the continuity equation pf + 3H{pf + Pf) = 0. Equations (HJ and ([5]) 
can be written as 

. K 8ttG,^ , • K 47rG / „N 



where 

1 



Pd 
Pd^ 



SttG 
1 



f^xX + ^{FR- f)-'SHF 



F + 2HF-^{FR^f) 



(8) 

Note that a hat to represent quantities in the non-equilibrium description of thermo- 
dynamics. If the density pd and the pressure Pd of "dark" components are defined 
in this way, these obey the following equation 

/}d + 3Hipd + Pd)^^{H^+K/a^)F, (10) 

where we have used Eq. (jH]). For the theories with F ^ 0, the right-hand side (r.h.s.) 
of Eq. (jlOp does not vanish, so that the standard continuity equation does not hold. 
This occurs for f{R) gravity and scalar-tensor theory. 

We examine the thermodynamic property of the theories given above. To be- 
gin with, the apparent horizon is determined by the condition h"^^ dardpf — 0, 
which means that the vector Vf is null on the surface of the apparent hori- 
zon. For the FLRW space-time, the radius of the apparent horizon is given by 
TA = {H^ + K/a'^) . In the Einstein gravity, the Bekenstein-Hawking horizon 
entropy is gi ven by 5* = A/ {AG), where A = Anf\ is the area of the apparent 
horizon.m^El ^j^g context of modified gravity theories, a horizon entropy 5* asso- 
ciated with a Noether charge was introduced by Wald.^^l^ The Wald entropy 5 is a 
local quantity defined in terms of quantities on the bifurcate Killing horizon. More 
specifically, it depends on the variation of the Lagrangian density of gravitational 
theories with respect to the Riemann tensor. This is equivalent to S* = A/{4:Gcff), 
where Gcs — G/F is the effective gravitational coupling. -'^'^ By using the Wald 
entropy 



1,2011 1:40 WSPC/INSTRUCTION FILE Bamba-9 



4 K. Bamba, C. Q. Geng and S. Tsujikawa 

we obtain 

= A7rf\H (prf + Pd + pf + Pf) dt + ^dF . (12) 
The apparent horizon has the following Hawking temperature 

where is Ks = - (rA/2) (h + 2H^ + K/a^^ = -2nG/ (3F) (^pr - 3Pt) , with 

Pt = Pd.-^ Ps and Pt = Pd + Pf- As long as the total equation of state wt = Pt/pt 
satisfies wt < 1/3, we have Kg < 0, which is the case for standard cosmology. Then, 
Eq. can be written as 



TdS ^ ATTf\H{pd + Pd + Pf + Pf)dt~2nf\{pd + Pd + Pf + Pf)dfA + ^7rf\dF . (14) 

In the Einstein gravity, the Misner-Sharp energjElis defined to be i? = fA/{2G). 
In f{R) gravity and scalar-tensor theory, this may be extended to the form E — 

1 9 

fAF/{2G).'^^ Using this latter expression for f{R,(j),X) theories, we find 
^ taF iF{H^_^K/^ 

where V = 47rf^/3 is the volume inside the apparent horizon. It follow from Eq. (llSp 
that 

d^ - -ATTf\H{pd + Pd + Pf + Pf)dt + 4nf\{pd + Pf)dfA + ^dF . (16) 

The combination of Eqs. ([T^ and ([T5|) gives 

TdS* ^ -dE + WdV + ^ (1 + 2^7^ aT) dF , (17) 

where we have introduced the work density defined bjffSHHlS] _ j-^^ ^ p^. ^ 
Pf)/2. This equation can be written in the following form: 

TdS" + Td,S = -dE + WdV , (18) 



where 



— i^(l + 27rfA^)dF = - 
7^ AH^ + H + 2>K/a? 




r I . ^dF, (19) 

which is consistent with the resulli^ of Ref . [TBI for K — Q obtained in /(i?) gravity 
and scalar-tensor theories. The new term d^S* can be interpreted as a term of entropy 
production in the non-equilibrium thermodynamics. The theories with F = constant 
lead to diS = 0, which means that the first-law of the equilibrium thermodynamics 
holds. On the other hand, the theories with dF ^ 0, including /(i?) gravity and 
scalar-tensor theory, give rise to the additional term (|19p . 
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3. Equilibrium description of thermodynamics in modified gravity 

The energy density pd and the pressure Pd defined in Eqs. ([8]) and ([9]) do not satisfy 
the standard continuity equation for _F 7^ 0. If it is possible to define pd and Pd 
so that they can satisfy the conserved equation, the non-equilibrium description of 
thermodynamics may not be necessary. In this section, we demonstrate that such a 
treatment is indeed possible. 

One can write Eqs. (|1]) and ([5]) as follows: 



3[H'' + ^] ^8nGipd + Pf) 



K 



8ttG (pd + Pd + Pf+Pf): 



where 



1 



Pd^- 



8ttG 
1 

8^ 



f.xX 



f) - 3HF + 3(1 - F){H^ + K/a^ 



F + 2HF 



liFR 



/) - (1 - F){2H + + K/a^) 



(20) 

(21) 
(22) 



If we define pd and Pd in this way, they obey the following continuity equation 
Pd + 3H(pd + Pd) = 0, where we have used Eq. In the equilibrium description, 
the energy-momentum conservation in terms of "dark" components is met. Since 
the perfect fluid of ordinary matter also satisfies the continuity equation, the total 
energy density pr = Pd+Pf and the total pressure Pt = Pd+Pf of the universe obey 
the continuity equation pt + 3H{pt + Pt) = 0. Hence, the equilibrium treatment of 
thermodynamics can be executed simil arly to that in the Einstein gravity. We in- 
troduce the Bekenstein-Hawking entropjUJ^5' = A/ (4G) = tt/ [G {H"^ + K/a'^)] , 
unlike the Wald entropy. This allows us to obtain the equilibrium description of 
thermodynamics as that in the Einstein gravity. It follows that 



1 



2'KrA 



dS = ATif\H {pd + Pd + Pf + Pf) dt . 



(23) 



Using the horizon temperature in Eq. (jl3p . we get 



TdS = A^f\H{pd + Pd + Pf + Pf)dt - 2Tif\{pd + Pd + Pf + Pf)dfA . (24) 
By defining the Misner-Sharp energy to he E — r a/ (2G) = V [pd + p/) , we obtain 
dE = -AT:r\H{pd + Pd + Pf + Pf )dt + AT:f\{pd + Pf)dfA ■ (25) 



Due to the conservation equation for "dark" components, the r.h.s. of Eq. ((25|) does 
not include an additional term proportional to dF. Combing Eqs. (|24l) and (P5|) 
gives 



TdS' = -dE + WdV , 



(26) 



where the work density W is defined by W — {pd + Pf — Pd — Pf) f^- Equation 
(|26p corresponds to the first law of equilibrium thermodynamics. This shows that 
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the equilibrium form of thermodynamics can be derived by introducing the energy 
density pd and the pressure Pd in a suitable way. It follows from Eq. (l26l) that 

TS^v(^m~^^{pd + Pf + Pd + Pf). (27) 

Using V = 47rf^/3 and Eq. p^ . we acquire 

S = 6nHVfMpd + Pf+Pd + Pf) = ■ ^ 

The horizon entropy increases as long as the null energy condition pT + Pt = 
+ P/ + -Pd + -P/ > is met. 

The above equilibrium description of thermodynamics is intimately related with 
the fact that there exists an energy momentum tensor T^t^ satisfying the local 
conservation law V^tI;^^} ~ 0. This corresponds to writing the Einstein equation in 
the form 

G^, = 8^G(r^? + r^f)) , (29) 

where 

^5M-(/-^) + V^V,F-5^,nF+i/,xV^</)V,</)+(l-P)i?^, 



y(d) ^ 1 



(30) 



Defining T^? in this way, the local conservation of 1)1? follows from Eq. ([29| because 
of the relations VGf,^ = and VT^f ^ = 0. 

It can be shown that the horizon entropy S in the equilibrium description has 
the following relation with S in the non-equilibrium description: 

dS-d^ + d S+ ""^ dF Ml-F) H{H-K/a') 

dS-dS + d,S + ^dF (^2 + ;^/^2)2di- (31) 

By using the relations ((T9)) and ((23)) . Eq. (|3T]) is rewritten to the following form 

d5=ld5+l^^^±^±^d.^, (32) 

where 

^_ 67T 4H^ + H + 3K/a^ dF 

"^'^ ' G m + K/a^ R ■ ^■^■^> 

The difference appears in modified gravity theories with dF 0, whereas S is 
identical to S in the Einstein gravity {F = 1). From Eq. (|32l) . we see that the change 
of the horizon entropy 5 in the equilibrium framework involves the information of 
both dS and diS in the non-equilibrium framework. 

As an example, we apply the formulas of the horizon entropies in the Jordan 
frame to infiation in f{R) theories. In what follows, we assume the flat FLRW 
space-time {K — 0). We consider the model f{R) = R + aR" {a,n > 0) in the 
region F — df /dR = 1 + naR"^^ ^ 1. The first inflation model for n = 2 has 
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been proposed by Starobinsky!!^ During inflation, the approximations \H/H^\ <^ 1 
and \H/{HH)\ <C 1 can be used. With these approximations, in the absence of 
matter fluids the first equation in ([20]) is reduced to H/H'^ = — /3, where /3 = 
(2— n) / [{n — l)(2n — 1)] . From this, we see that the scale factor behaves as a cx t^/^ . 
Hence, for ^ < 1, i.e. n > (1 + \/3)/2, power-law inflation occurs. If n = 2, one 
obtains /3 = 0, so that H is constant in the regime ^ 1. The models with n> 2 
lead to the super-inflation characterized by ij > and a cx |io ~ (^o is 

a constant). The standard inflation with decreasing H occurs for < /? < 1, i.e. 
(1 + V3)/2 < n < 2. In this case, the horizon entropy S = A/ (4G) = tt/ (GiJ^) 
in the equilibrium framework grows as 5 cx H^^ cx during inflation. Meanwhile, 
the horizon entropy S = F{R)A/{4,G) in the non-equilibrium framework has a 
dependence S cx R"'-^/H^ cx 7j2(n-2) ^ ^2(2-™) -^^ ^^le regime > 1. Thus, S 
grows more slowly relative to S. This property can be understood from Eq. p2l) . 
i.e. 

dt F dt F 4:^13 dt ' ^ ' 

where 

-df^ G ^^^^ 

Here, F/? = dF/d_R. For the above model, the term F = naK"^^^ evolves as 
F cx This means that {\/F)dS/dt cx t in Eq. (j34[) . which has the same 

dependence as the time-derivative of 5, i.e. dS/dt cx t. The r.h.s. of Eq. (pSj) is 
positive because F^p > and /3 > 0, so that diS/dt > 0. We have diS/dt cx i^-^n 
and therefore the last term on the r.h.s. of Eq. p4p also grows in proportion to t. 
As a consequence, S evolves differently from S due to the presence of the term l/F. 



4. Summary 

We have explored thermodynamics on the apparent horizon with area A in the 
expanding cosmological background for a wide class of modified gravity theories 
with the Lagrangian density f(R,(j),X). We have examined both non-equilibrium 
and equilibrium descriptions of thermodynamics. 

In a non-equilibrium description of thermodynamics, the energy density and 
the pressure of "dark" components are defined such that they cannot satisfy the 
standard continuity equation for the theories in which the quantity F — df/dR is 
not constant. In addition, the Wald's horizon entropy in the form 5* = AF/{4:G) 
associated with a Noether charge is introduced, so that a non-equilibrium entropy 
production term diS appears. This non-equilibrium description of thermodynamics 
arises for the theories with dF ^ 0, which include f{R) gravity and scalar-tensor 
theories. 

On the other hand, it is possible to acquire an equilibrium description of ther- 
modynamics by defining the energy density and the pressure of "dark" components 
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SO that they can obey the standard continuity equation. In other words, this conies 
from a suitable definition of an energy momentum tensor of the "dark" compo- 
nent that respects to a local energy conservation law in the Jordan frame. In this 
framework, the horizon entropy S in equilibrium thermodynamics is equal to the 
Bekenstein-Hawking entropy in the form S = A/ (AG), as in the Einstein gravity. 

Moreover, we have found that the variation of S can be expressed in terms of dS 
in the non-equilibrium framework together with the entropy production term diS. It 
is considered that the equilibrium description of thermodynamics is useful not only 
to provide the General Relativistic analogue of the horizon entropy irrespective of 
gravitational theories but also to understand the nonequilibrium thermodynamics 
deeper in connection with the standard equilibrium framework. 
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